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(54) Image recognition unit for preventing counterfeit copies 



(57) An image recognition unit can be installed eas- 
ily in a variety of image generator devices and which is 
capable of highly accurate image recognition. The print 
data output by print engine interface for laser light 
source 1 1 , which are expressed in binary data form, are 
input into image recognition unit. Based on these binary 



data, the recognition unit determines whether the image 
to be copied is a banknote, stock certificate, or other 
prohibited document, and sends its result to print engine 
control unit. If the image is a banknote or other non-re- 
producible document, the print engine is prevented from 
generating the image. 
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Description 

[0001] This application claims priority from Japanese 
patent application no. P 1 0-79024, filed March 26, 1 998, 
the entire contents of which are incorporated by refer- 5 
ence herein. 

Field of the Invention 

[0002] This invention concerns an image recognition 
unit to prevent counterfeiting of banknotes, stock certif- 
icates or other documents which may not be legally re- 
produced. 

Background of the Invention 

[0003] As the resolution and tonal processing capa- 
bility of image generator devices such as copiers and 
printers has become increasingly sophisticated, the 
quality of the print image has continued to improve. The 
outstanding resolution which color image generators 
are now capable of has led the industry to focus on the 
potential for counterfeiting banknotes and stock certifi- 
cates. A demand has therefore arisen for anti-counter- 
feiting units which can be installed in color image gen- 
erators to prevent this crime from occurring. 
[0004] A first method used by anti-counterfeiting units 
which are installed in color image generators entails 
placing a specific pattern which is difficult to discern with 
the naked eye on the original documents at the time they 
are printed. A specific device can then use a specific 
process to extract the pattern in order to determine 
which anti-counterfeiting unit produced the image. 
[0005] A second method is to use an image generator 
with an image recognition unit as described in U.S. pat- 
ent application no. 08/915,473 , the contents of which 
are incorporated by reference herein. Using the image 
data needed to generate the image, this unit determines 
whether the image being generated is a banknote, stock 
which are incorporated by reference herein. Using the 
image data needed to generate the image, this unit de- 
termines whether the image being generated is a ban- 
knote, stock certificate or other document which may not 
be reproduced. The image recognition unit uses the im- 
age data comprising the bit image in the control unit of 
the image generator to recognize a banknote, stock cer- 
tificate or other proscribed document and sends a signal 
to the image generator to prevent printing once it recog- 
nizes the counterfeit image. 

[0006] The first anti-counterfeiting method mentioned 
above is not a particularly effective way to prevent coun- 
terfeiting. This is because the counterfeit banknote or 
stock certificate is already created and the creator of 
such an illegal copy can intentionally, use the copy as 
an original although it has a specific pattern that identi- 
fies it as a counterfeit copy. In the other words, the trac- 
ing of counterfeit bills or certificates produced in this way 
can begin only after they are used. 



[0007] In the second method mentioned above, be- 
cause at least three types of color component data are 
needed to generate a color image, the image recogni- 
tion unit must be able to correctly identify the color com- 
ponent data in order to recognize a bank note or stock 
certificate. To insure this capability, the control unit of 
the image generator must have a very complex design, 
and, as a result, it is unable to easily extract the signals 
needed to recognize the image. This makes the image 
recognition unit less flexible and difficult to install at the 
same circuit position in different types of image process- 
ing devices. 

Summary of the Invention 

[0008] The present invention was developed in con- 
sideration of the difficulties outlined above. An object of 
the invention is to provide an image recognition unit for 
preventing counterfeit copies which can easily be in- 
stalled in a variety of image processing devices or gen- 
erators and which is capable of highly accurate recog- 
nition. The invention is specially characterized in that 
the image recognition unit according to these inventions 
can be installed between the existing control unit of the 
image generator device and the print engine unit of the 
same device where the binary signals for the each color 
component are produced transmitted to a laser light 
source for reproduction of an image. The light from laser 
light source creates a latent image on photosensitive 
substance for copying. 

[0009] This image recognition unit has an image rec- 
ognition device to recognize a specific illegal image, 
which is specifically provided between the control unit 
of the image generator device and the print engine unit 
of the same device, and a preventing device to prevent 
printing the illegal image, which executes an operation 
to prohibit printing when the image recognition device 
has recognized a counterfeit image which may not be 
printed. 

[001 0] The aforesaid image recognition device recog- 
nizes a specific illegal image which may not be printed 
using at least one type of the binary color component 
pattern data needed to generate a color image. 
[0011] The image recognition device may be provided 
with a converting device to convert the binary pattern 
data to tonal data, which are then used to recognize the 
image. 

[0012] In some types of image generators, each dot 
in the pattern data for tonal reproduction is divided into 
a number of segments, for example 4 segments, in order 
to smooth the edges of an image. In this case, the image 
recognition device counts the number of black seg- 
ments, and the count can represent the tonal data. 
These tonal data are then used to recognize the image. 
[0013] Another embodiment of an image recognition 
device counts the number of black segments in a square 
or cross-shaped region formed by several dots, and the 
count can represent the tonal data. These tonal data are 
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then used to recognize the image. 
[001 4] In another embodiment, the image recognition 
device treats these black segment data as a hexadeci- 
mal number and compares this value with the numerical 
value obtained by interchanging its upper and lower bits. 
The smaller of the two numerical values is then consid- 
ered as the tonal data. These converted tonal data 
would then be used to recognize the image. 
[0015] In another embodiment, the image recognition 
device treats these black segment data as a hexadeci- 
mal number and compares this value with the numerical 
value obtained by interchanging the upper and lower 
bits. The smaller hexadecimal values existing in a 
square or cross-shaped region formed by several dots 
are then summed up for the converted tonal data. These 
converted tonal data would then be used to recognize 
the image. 

[0016] The image recognition device may also have 
storage unit to store the data representing a feature 
count obtained from converted tonal data, and recog- 
nize the illegal specific image by comparing a plurality 
of the converted tonal data of every color component. 
[001 7] Alternatively, such a storage un it may compare 
the feature count obtained from the n-th datum of the 
image data with that obtained from the (n - 1 )-th datum 
and store the result. 

Brief Description of the Drawings 

[001 8] Figure 1 is a block diagram of the internal con- 
figuration of the image recognition unit according to this 
invention. 

[0019] Figure 2 illustrates an image recognition de- 
vice in the image recognition unit of Fig. 1 , which stores 
a feature set in the storage unit. 
[0020] Figure 3 illustrates a method to store a feature 
count in the storage unit of the same image recognition 
unit. 

[0021] Figure 4 illustrates another method to store a 
Feature count in the storage unit of the same image rec- 
ognition unit. 

[0022] Figure 5 illustrates yet another method to store 
a feature count in the storage unit of the same image 
recognition unit. 

[0023] Figure 6 illustrates yet another method to store 
a feature count in the storage unit of the same image 
recognition unit. 

[0024] Figure 7 shows an example of multi-valued im- 
age obtained by executing tonal reproduction on the 
color pattern data obtained by the image recognition 
unit. 

[0025] Figure 8 illustrates one method to convert a bi- 
nary image to a multi-valued image according to a pre- 
ferred embodiment of an image recognition unit. 
[0026] Figure 9 illustrates another method to convert 
a binary image to a multi-valued image according to an- 
other preferred embodiment of an image recognition 
unit. 



[0027] Figure 10 illustrates yet another method to 
convert a binary image to a multi-valued image accord- 
ing to another preferred embodiment of an image rec- 
ognition unit. 

s [0028] Figure 11 illustrates yet another method to con- 
vert a binary image to a multi-valued image according 
to another preferred embodiment of an image recogni- 
tion unit. 

[0029] Figure 12 illustrates yet another method to 
convert a binary image to a multi-valued image accord- 
ing to another preferred embodiment of an image rec- 
ognition unit. 

[0030] Figure 1 3 is a block diagram of the basic con- 
figuration of a prior art generic image generator device. 
[0031] Figure 1 4 is an example of a print image print- 
ed by a prior art image generator device. 
[0032] Figure 15 is an example of a dot matrix print 
data of a prior art image generator device. 
[0033] Figure 16 is another example of a dot matrix 
print data of a prior art image generator device. 

Detailed Description of the Invention 

[0034] Figure 1 3 is a block diagram showing the basic 
structure of a generic image generator device according 
to the prior art. The components from host interface 1 
through print engine interface 6 constitute image gener- 
ator control unit 10. Image data which are input via host 
interface 1 are stored in frame memory 2. This memory 
can store enough data to represent the image on a sin- 
gle sheet of paper. The image data stored in frame mem- 
ory 2 have their color adjusted by image processing unit 
3. They are converted to a print data in print data con- 
version unit 4 and stored in print data memory 5. 
[0035] The components from print engine control unit 
7 through paper tray 15 constitute print engine unit 20. 
The print data from print engine interface 6 consists of 
ON and OFF signals for laser light source 11 . The light 
from laser light source 11 creates a latent image on pho- 
tosensitive substance 1 3. When toner is supplied from 
toner cartridge 12, an actual image is created on pho- 
tosensitive substance 1 3. This toner, organized into an 
image, is transferred to intermediate transfer substance 
14. When this process is repeated for each process 
color (yellow, magenta, cyan and black), a full-color im- 
age is generated on intermediate transfer substance 1 4. 
The image on transfer substance 1 4 is transferred to pa- 
per 17, which is supplied from paper tray 15. The toner 
is tixed onto paper 17 by fixer 16. 
[0036] Generally, the print data from print engine in- 
terface 6 will be a dot matrix, an example of which is 
shown in Figure 14. Such a matrix reproduces concen- 
trated dark areas by means of a systematic arrange- 
ment of black dots of various sizes. For actual color im- 
ages, additional dot matrices of yellow, magenta and cy- 
an are overlaid to reproduce tone and concentration. 
[0037] Figure 1 5 shows an example of print data con- 
stituting a dot matrix. By switching laser light source 11 
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on and off, the print engine unit 20 creates a latent image 
of the dot matrix on photosensitive substance 1 3. The 
size of the area which receives or does not receive the 
laser light when light source 11 is switched on and off is 
predetermined according to the type of the image gen- s 
erators. The minimum size hit by laser light is called a 
■dot". A square area consisting of several to several doz- 
en dots is called a "square". A single dot matrix is formed 
in a square of a given size. For example, as can be seen 
in Figure 1 5, dots created by switching laser light source 
11 on and off are arranged to form a black circle in the 
center of the square. When the square in which this dot 
matrix is created is replicated systematically over the 
entire print area, the printing by this image generator is 
completed. If, as is shown in Figure 15, a dot matrix is 
formed in a region consisting of 8 dots x 8 dots, it will be 
capable of 65-tonal density reproduction. 
[0038] Figure 1 6 shows another example of print data 
which generates a dot matrix. When a dot matrix is cre- 
ated in a square area consisting of several to several 
dozen dots by switching laser light source 11 on and of 
in units of a single dot, the size of the dot matrix which 
is reproduced, that is, its tonal density reproducibility, 
will be still low. This is because the quality of the image, 
for example as shown by how smooth the curve of the 
circumference of the circle is, will still be poor. To insure 
the highest quality possible, the laser light source 11 can 
be operated with even finer on-off control in the scan- 
ning direction. By subdividing a single dot into even 
smaller regions, we can mitigate the problem of rough 
or jagged edges. If, for example, we use the same 8 x 
8 square as in Figure 15, but create a finer matrix by 
segmenting each dot into 4 regions as shown in Figure 
16, our matrix will be capable of reproducing 257 tonal 
density, and the edges of forms will appear smoother. 
[0039] Figure 1 is a block diagram of an image gen- 
erator device according to a preferred embodiment of 
the inventions. In the embodiment shown in Figure 1, 
an image recognition unit 8 is placed between the print 
engine interface 6 of the image generator control unit 
1 0 and print engine control unit 7 of the print engine unit 
20. 

[0040] In the image generator device of Fig. 1, the 
print data from the image generator control unit 10 are 
sent in parallel to laser light source 1 1 and to image rec- 
ognition unit 8. Using these data, image recognition unit 
8 executes image recognition and determines whether 
the image to be copied is a banknote, stock certificate 
or other document which may not be reproduced. It 
sends the result of this determination to print engine 
control unit 7. In this embodiment, it is important that the 
print data representing a copy image from print engine 
interface 6 to laser light source 11 generally is ex- 
pressed by only two values (binary value), which repre- 
sents switching light source 11 on or off. In some types 
of image generators, multi-value data (for example, hex- 
adecimal data) may be used to express the print data. 
The multi-value data is, however, used to express the 



ON/OFF signal for a group of some dots or some seg- 
ments in a single dot which defines the tonal density re- 
production. These print data are generally output along 
with other control data, such as an output start signal, a 
horizontal cycle signal, a vertical cycle signal or a cycle 
clock signal. Since the various types of image generator 
devices all have virtually the same specifications, and 
the print engine interface 6 outputs the print data along 
with the same kind of control data, it is therefore rela- 
tively simple to install image recognition unit 8 between 
the print engine interface 6 and print engine control 7. 
Image recognition unit 8 according to this invention will, 
therefore, be able to receive the print data from print en- 
gine interface of many types of image generator devic- 
es. 

[0041] The print data which print engine interface 6 of 
the image generator device outputs to laser light source 
1 1 are binary data. The image generator device outputs 
these print data for every color component needed to 
reproduce the color image. 

[0042] First, as can be seen in Figure 2, the pseudo- 
reproduction of tonal image (22 .,) is formed using the 
print data of the first color component 21 A . At this point, 
the first color component pattern is extracted (23^, ) from 
the pseudo-reproduced tonal image which is defined by 
multi-value color data. This extraction of the first color 
component pattern is executed using a number of pre- 
viously established threshold values defined by a multi- 
value color data. A feature set representing the shape 
is then obtained (24^. The obtained feature set data 
representing the shape of the first color component pat- 
tern is then compressed (25 -,), and stored temporarily 
in storage unit 26. The form of the feature set to be 
stored can be defined by a number of available 
schemes, which will be discussed shortly. 
[0043] The print data for the second color component 
(21 2 ) are then reproduced (22 2 ) in the same fashion, 
and a feature count representing the shape of the sec- 
ond color component pattern is obtained (24 2 ). The da- 
ta for the feature set obtained for the second color com- 
ponent pattern is not, however, stored in its raw form. 
Instead, the feature set obtained from the first color is 
retrieved (27 2 ) to compare to the feature set of the sec- 
ond color component pattern. The revised feature set is 
then obtained and compressed (25 2 ), and it is stored in 
storage unit 26. 

[0044] In the same way, the feature set obtained from 
the print data for the third and fourth color components 
are compared to the stored feature set to produce the 
revised feature set. 

[0045] The feature set obtained from the print data for 
all color components is then input into discrimination unit 
28 to discriminate the image of a bank note or stock cer- 
tificate from an image to be checked. 
[0046] The feature set obtained here is the result of a 
comparison between the shapes obtained from the print 
data of at least 2 color components, so it includes the 
feature set of color phase, saturation and brightness. 
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And since a feature set for the shape is obtained from 
the print data for a number of color components and 
compared with the previous feature set each time, an 
extremely accurate feature set can be obtained. 
[0047] We will now explain the form of the feature set 
mentioned above. An example of how a feature set may 
be stored in storage unit 26 is shown in Figure 3. In this 
first example, the obtained entire image of the feature 
set is reduced and stored in the storage unit 26. In a 
second example, shown in Figure 4, the obtained entire 
print image is encoded and compressed before it is 
stored in the storage unit 26. A third example is shown 
in Figure 5. Here the feature set data are stored in the 
storage unit along with data indicating the locations of 
the obtained print images. In this case several square 
regions of a given size within the image are scanned. If 
the feature sets are found in these regions, the leftmost 
point on the tops of the regions are defined as an origin 
of the coordinate axes, and the coordinate of the lower 
right corners are stored as their ends. At the same time, 
the feature sets for the shapes are encoded, and stored 
in the storage unit. 

[0048] Additionally, another example is shown in Fig- 
ure 6. The print images in a region having a predeter- 
mined size which includes the obtained feature set are 
stored in the storage unit. The region is defined as to 
include the entirety of the feature set. In this case, a 
color component pattern is scanned by a square region 
of a given size. If a shape to be recognized which has 
a feature set for shape is found in the scanning region, 
the shape images in the region are stored in the storage 
unit. 

[0049] We shall next explain several schemes which 
can be used in the image recognition unit according to 
the present inventions to convert a binary pattern data 
to a m u It i -valued pattern data, 

[0050] Figure 7 is an example image which is formed 
by converting the binary pattern data to multi-valued pat- 
tern data by counting the black dots in each 8 x 8 dot 
region. 

[0051] Another scheme can be used when each dot 
in the pattern data for tonal reproduction is divided into 
a number of segments. The number of black segments 
in a dot is divided into, for example, N segments. In the 
example shown in Figure 8 (a), the number of the black 
segments out of 4 segments is counted, and the tone 
density of each dot can be expressed as one of five val- 
ues from 0 through 4, as is shown in Figure 8 (b). 
[0052] Another scheme to convert binary pattern data 
to a mutti-valued pattern data is shown in Figure 9. Each 
dot in the pattern data for tonal density reproduction is 
divided into a number of segments, and the total number 
of black dots in a region measuring N x N dots repre- 
sents the tonal density value. In this case, if one seg- 
ment of a dot is black, the value of that dot will be 1 . In 
the example shown in Figure 9 (a), for example, the tone 
density will be reproduced using 4x4 dot regions in 
which each dot has been divided into four segments. A 



single dot will can have a value between 0 and 4. When 
these values are compiled for a 16-dot region, they ex- 
press one of 65 possible tones, as is shown in Figure 9 
(b). 

5 [0053] Yet another conversion scheme to convert a 
binary pattern data to a multi-valued pattern data is 
shown in Figure 10. The each dot in the pattern data for 
tonal density reproduction is divided into a number of 
segments, and the black segments in a dot represent a 
10 hexadecimal number tonal density value. The hexadec- 
imal number obtained in this way is compared with the 
number obtained by interchanging its upper and lower 
bits, and the smaller of the two numbers is used as the 
tonal density value of the dot. In the example shown in 
*5 Figure 10 (a), for example, tone density is reproduced 
from data obtained by dividing each dot into four seg- 
ments, and when the black segments of each dot are 
counted, its black segments can be expressed as one 
of sixteen tones from 0 through F, as is shown in Figure 
10(b). 

[0054] Yet another conversion scheme to convert a 
binary pattern data to a multi-valued pattern data is 
shown in Figure 11. The each dot in the pattern data for 
tonal reproduction is divided into a number of segments, 
and the black segments in a dot represent a hexadeci- 
mal number tonal density value. The hexadecimal num- 
bers obtained in this way which are in a region ofMxM 
dots are summed up. Before summing up, the hexadec- 
imal number is compared with the number obtained by 
interchanging its upper and lower bits, and the smaller 
of the two numbers is used as the tonal density value of 
the dot. In the example shown in Figure 11 (a), for ex- 
ample, tone is reproduced from data obtained by divid- 
ing each dot into four segments, and when every hexa- 
decimal numbers of 1 6 dots are summed up, and the 
total number of these hexadecimal numbers can be ex- 
pressed as one of 256 tones, as is shown in Figure 11 
(b). 

[0055] Yet another conversion scheme to convert a 
binary pattern data to a multi-valued pattern data is 
shown in Figure 12. The each dot in the pattern data for 
tonal density reproduction is divided into a number of 
segments, and the number of black segments in the 
cross-shaped region shown in Figure 12 (a) represents 
the tonal density value. Here, again, a single black seg- 
ment in a dot gives it a tonal value of 1 . Tone is repro- 
duced using the cross-shaped region in each 4X4 dot 
area, with each dot divided into four segments, as 
shown in Figure 12 (b). A given dot will have a value 
from 0 thorough 4. When the values of all the dots in a 
1 2-dots region of the cross-shaped region are summed 
up together, their sum will express one of 49 possible 
tone densities, as is shown in Figure 12 (c). 
[0056] According to this invention, an image recogni- 
tion device is provided between the control unit of the 
image generator device and the print engine uiiit of the 
same device to obtained the print data which are ex- 
pressed in binary data form. When this image recogni- 
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tion unit recognizes an image which may not legally be 
printed, a preventing operation is executed to prevent 
the printing. Because the image recognition unit obtains 
a feature count from every color component of an image 
based on the print data of each color component, its ac- 
curacy with respect to recognition is extremely high. 
Since the print data for all color components which are 
expressed in binary data form are easy to obtain from 
any type of image generator device and the binary data 
form is relatively similar from machine to machine, a uni- 
versal-type interface can be used to input data into the 
image recognition unit. 



Claims 

1 . An device for prohibiting the reproduction of specific 
patterns, the device comprising: 

an image recognition device connectable to a 
reproduction engine of the image reproduction 
device for recognizing a specific pattern for 
which reproduction is prohibited based on bina- 
ry data for controlling the reproduction engine; 
and 

a preventing device connected to the image 
recognition device and connectable to the re- 
production engine to prevent the reproduction 
engine from reproducing a specific pattern rec- 
ognized by the image recognition device. 

2. A device according to claim 1 , wherein said image 
recognition device is configured so as to recognize 
said specific pattern based on a binary data of at 
least one color component forming said specific 
pattern. 

3. A device according to claim 2, wherein said image 
recognition device comprises a converting device 
to convert said binary data to a tonal density data 
which is expressed by a multi-valued data, and said 
converted tonal density data is used to recognize 
said specific pattern. 

4. A device according to claim 3, wherein an image 
dot forming said specific pattern is divided into a plu- 
rality of segments, and said converting device 
counts a number of segments hit by a laser beam 
from said laser source in order to convert said bina- 
ry data to said tonal density data. 

5. A device according to claim 4, wherein said convert- 
ing device counts a number of segments in a square 
region formed by several dots. 

6. A device according to claim 4, wherein said convert- 
ing device counts a number of segments in a cross- 
shaped region formed by several dots. 



10 

7. A device according to claim 5, wherein said convert- 
ing device converts said binary data to said tonal 
density data by obtaining first multi-value data from 
an original arrangement of said plurality of seg- 

5 ments; 

obtaining second multi-value data from said 
plurality of segments by interchanging upper 
and lower bit segments of the first multi-value 
10 data; 

comparing said first and second multi-value da- 
ta; and 

providing the smaller of the first and second 
multi-value data as a tonal density value. 

15 

8. A device according to claim 7, wherein 

said converting device sums up a plurality of 
said tonal density values in a square region formed 
by several dots in order to convert said binary data 
20 to said tonal density data. 

9. A device according to claim 7, wherein 

said converting device sums up a plurality of 
said tonal density values in a cross-shaped region 
25 formed by several dots in order to convert said bi- 
nary data to said tonal density data. 

1 0. A device according to claim 3, wherein said convert- 
ing device converts a plurality of said color compo- 

30 nent data forming said specific pattern into a plural- 
ity of said tonal density data and stores said tonal 
density data in a storage unit, and a discrimination 
unit discriminates said print data based on said plu- 
rality of said tonal density data if said print data has 
35 said specific pattern. 

11. A device according to claim 10, wherein 

a tonal density data of a color component data 
is compared with a previously obtained tonal den- 
40 sity data of other color component data successive- 
ly, and a result of said comparison is stored in said 
storage unit for recognizing said specific pattern. 

12. An image reproduction system comprising: 

45 

a reproduction engine; 

an image recognition device connected to the 
reproduction engine for recognizing a specific 
pattern for which reproduction is prohibited 
50 based on binary data for controlling the repro- 

duction engine; and 

a preventing device connected to the image 
recognition device and the reproduction engine 
to prevent the reproduction engine from repro- 
55 ducing a specific pattern recognized by the im- 

age recognition device. 

1 3. A method for preventing the reproduction of specific 
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patterns comprising the steps of: 

performing pattern recognition based on binary 
data for controlling the reproduction engine of 
an image reproduction device; and 5 
preventing a reproduction engine of the image 
reproduction device from reproducing a specif- 
ic pattern recognized in the pattern recognition 
step. 

10 

1 4. The method of claim 1 3, further comprising the step 
of: 

converting said binary data to tonal density da- 
ta expressed by a multi-valued data; is 
wherein the pattern recognition step is per- 
formed using the tonal density data. 
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FIGURE 6 
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